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Summary:  Some  questions  concerning 
properties  of  "behavior  strategies  are 
answered  by  means  of  an  example. 


TWO  EXAMPLES  CONCERNING  BEHAVIOR  STRATEGIES 
F.  B.  Thompson  and  E.  Wagner 

So  far  little  seems  to  be  known  about  behavior  strategies  in  finite 
games .  The  authors  feel  that  in  such  a  young  domain  the  exhibition  of 
examples  is  not  out  of  order.  There  are  a  number  of  questions  which  thus 
can  be  quickly  answered  and  the  way  cleared  for  deeper  inquiry. 

The  notion  of  behavior  strategy  was  first  formalized  by  Kuhn  in  his 
paper  "Extensive  Games’'  [  1  ]  .  However  it  is  implicitly  used  by  earlier 
investigators  [2  J  .  It  will  be  assumed  that  the  reader  is  familiar  with 
the  concepts  involved. 

1:  Notation 

The  two  examples  to  be  presented  differ  only  in  payoff  function.  Thus 
we  shall  exhibit  here  the  game-tree  with  the  player  and  information  partitions 
shown  thereupon: 


Pi 


EM- 7^7 


-2- 


The  I^1  "player"  or  team  Is  Indicated  "by  p^ .  The  alternatives  at  each 
move  are  to  "be  thought  of  as  numbered  In  the  clock-vise  order.  A  behavior 

strategy  for  pi  consists  of  a  pair  «  ai,  a|  >,  <  af,  a|  »  vhere  a* 

"til  till 

iB  the  probability  that  px  plays  the  J  alternative  at  his  i  move . 
Evidently  ai  +  a2  =  af  +  a|  =  1.  Similarly  a  behavior  strategy  for  ps  is 
«  bi,  b2  >,  <  bf,  bf  ». 

If  the  players  were  both  to  use  optimal  mixed  strategies  then  the 
expected  payoff  to  pi  vould  be  a  fixed  number  v  vhich  is  usually  called 
the  value  of  the  game.  It  Is  the  maximum  px  can  insure  himself  and  the 
minimum  to  vhich  pa  can  restrict  pi .  Let  "vi"  denote  the  maximum 
vhich  pi  can  insure  himself  vhen  using  behavior  strategies,  and  let  "v2" 
denote  the  minimum  to  vhich  p2  can  restrict  px  vhen  using  behavior 
strategies.  It  is  intuitively  evident  (and  follovs  formally  from  a  result 
of  Dalkey ' s)  that  vx  <  v  <  v2.  Dree  her,  Helmer  and  Wagner  ["5]  have 
exhibited  a  game  for  vhich  vx  /  v2 .  By  an  optimal  behavior  strategy  for  px 
ve  shall  mean  any  behavior  strategy  vhich  insures  him  .  By  an  optimal 
behavior  strategy  for  p2  we  shall  mean  any  behavior  strategy  for  p2  vhich 
restricts  pa  to  at  most  v2 . 

Pure  strategies  for  player  Pi  vill  he  denoted  by  "<.  i,J  >"  where 
1,  j  =  1,  2;  <  i,J  >  indicating  alternative  i  at  Pi's  first  move  and 

alternative  j  at  Pi’s  second  move.  Similarly  for  p2  . 
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For  thiB  game  the  following  values  can  "be  verified: 

(i)  Vi  =  0,  v  =  v2  =  1;  thus  y1  <  v  <  v2; 

(ii)  a  behavior  strategy  for  px  is  optimal  if  and  only  if  it  is  of 
the  form:  «  >,  <  h,  1-h  »  vhere  0  <  h  <  lj 

(ill)  a  behavior  strategy  for  p2  is  optimal  if  and  only  if  it  is 
of  the  form:  «  ^  >,  <  k,  1-k  »  vhere  0  <  k  <  1; 

(iv)  if  px  uses  «  >,  <  h,  1-h  »,  and  p2  uses 

«  >f  <  k,  1-k  »,  then  the  expected  payoff  is:  -  (h  -  ( k  -  . 

It  vill  first  be  noted  that  each  player  has  a  continuum  number  of  optimal 
behavior  strategies.  If  both  players  play  optimal  behavior  strategies,  the 

1  o 

payoff  -will  be  some  value  between  ^  and  ^  and  any  value  in  the  closed 
interval  ^  is  obtainable.  Thus  if  both  play  optimal  behavior  strategies 

the  payoff  vill  actually  be  greater  than  vx  and  less  than  v2 . 

One  is  immediately  led  to  the  question  of  "preferred"  optimal  behavior 
strategy.  This  suggests  the  induced  game  over  the  unit  square  whose  payoff 
is  H(h,  k)  =  ~  -  (h  -  7;)  (k  -  -|)  .  This  game  has  a  saddle-point:  h  =  k  =  ~  . 

Thus  one  might  conclude  that  the  "preferred"  optimal  behavior  strategies  are 

.  .  ,  ^,11^.11^  ^  1  1  1  1  ^ 

respectively  <<  2'  2  <  2’  2  >>>  K<  2'  2  <  2'  2  >>* 
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Uov  an  examination  of  the  above  game  raises  the  following  comments  and 
questions: 

( i)  A  convex  combination  of  optimal  mixed  strategies  is  always  an 
optimal  mixed  strategy.  We  note  that  in  our  first  example  the  convex 
combination  of  optimal  behavior  strategies  is  an  optimal  behavior  strategy. 

Is  this  always  the  case? 

(ii)  We  note  that  the  induced  game  we  considered  to  determine  the 
"preferred”  optimal  behavior  strategies  had  a  saddle-point  solution.  The 
corresponding  consideration  for  optimal  mixed  strategies  trivially  yields 
the  same  result  since  optimal  mixed  strategies  when  played  against  one-another 
always  give  v.  Will  there  always  be  such  a  saddle-point? 

3:  Second  example . 


Payoff  matrix: 


<  1,1  > 

<  1,2  > 

<  2,1  > 

<  2,2  > 

<  1,1  > 

0 

0 

2 

4 

<  1,2  > 

2 

2 

-2 

0 

<  2,1  > 

-1 

-2 

2 

2 

<  2,2  > 

4 

2 

0 

0 

For  this  game  the  following  values  can  be  verified: 

2  4 

(i)  vi  =  y  v  =  1,  v2  =  —  ; 

(ii)  Pi  has  exactly  two  optimal  behavior  strategies: 

Q.1  =  «  0.1  >,  <  |  »  and  22  =  «  1,0  >,  <  f ,  i  »: 

’  ’  3  3  *  3  o 

(iii)  p2  has  exactly  two  optimal  behavior  strategies: 

=  «  |,  i  >,  <  0,1  »  and  p2  =  «  i,  |  >,  <  1,0  »; 

( iv)  the  payoff  to  Pi  if  pa  plays  a.  and  p2  plays  (3 .  is 

J 


given  by  the  following  table: 
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We  thuB  are  in  a  position  to  ansver  the  questions  in -Section  2.  In  fact 
(i)  The  convex  camhination  of  optimal  behavior  strategies  (in  whatever 
meaningful  way  thiB  may  be  defined)  is  not  necessarily  an  optimal  behavior 
strategy. 

(ii)  The  induced  game,  whose  normal  form  is 


Pi  P2 

2  11 

ai 

3  9 

k  2 

a2 

|  3  3 

does  not  have  a  saddle-point  solution.  Thus  there  appears  to  be  no  way  for 
either  player  to  pick  out  a  "preferred"  optimal  behavior  strategy.  The 
existence  of  a  game  with  this  property  seems  to  us  to  indicate  a  deficiency 
either  in  the  usefulness  of  behavior  strategies  or  in  their  theory.  It  seems 
rational  to  expect  p2  to  play  an  optimal  behavior  strategy  (unless  p2 
is  playing  under  conditions  where  mixed  strategies  can  be  used,  a  situation 
which  is  excluded  here) .  In  our  first  example  Pi  could  choose  a  behavior 
strategy  which  would  not  only  insure  vx  against  all  behavior  strategies  of 
p2  but  insure  v  against  all  optimal  behavior  strategies  of  p2 ;  while  p2 
can  prevent  Pi  from  gaining  more  than  v  if  Pi  plays  an  optimal  behavior 
strategy.  This  is  not  the  case  in  example  two  where  p,_  can  insure  himself 
whereas  p2  can  only  be  sure  pi  receives  no  more  than  —■ 


no  more  than 
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Thus  the  vhole  question  of  hov  a  team  should  test  play  a  game  in  vhich  team 
members  are  separated  from  one  another  oyer  several  plays  seems  again  to  be 
thrown  open. 

There  is  an  observation  concerning  the  Becond  example  vhich  seems 
interesting.  As  is  veil  knovn  there  is  a  mixture  of  pure  strategies  of  Pi 
Buch  that  if  played  it  insures  px  at  least  v.  Hov  pure  strategies  can  be 
considered  as  a  subclass  of  the  class  of  behavior  strategies.  Thus  there  is 
a  mixture  of  behavior  strategies  vhich  if  played  insures  px  an  expected 


payoff  of  at  least  v.  However  if  one  computes  the  optimal  mixture  of  Pi's 

6  5 

optimal  behavior  strategies  one  obtains  the  mixture  yj  vith  a2, 


vhich  if  played  insures  Pi  no  more  than 


22 

33' 


thus  less  than  v. 


i 
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